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MAG4 is 
completely 
automated, from 
downloading 
magnetograms to 
outputting and 
storing forecast 
products. 
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Technology What is MAG4? 



• MAG4 (Magnetogram Forecast), developed originally for NASA/SRAG 
(Space Radiation Analysis Group), is an automated program that 
analyzes magnetograms from the HMI (Helioseismic and Magnetic 
Imager) instrument on NASA SDO (Solar Dynamics Observatory), and 
automatically converts the rate (or probability) of major flares (M- and 
X-class), Coronal Mass Ejections (CMEs), and Solar Energetic Particle 
Events 

• MAG4 does not forecast that a flare will occur at a particular time in the 
next 24 or 48 hours; rather the probability of one occurring! 

• GONG (Global Oscillations Network Group) magnetograms, can be 
used instead as a backup but at a lower forecast accuracy 

• Present cadence of new forecasts: 96 minutes (60 minutesfo CCMC) 
Vector magnetogram actual cadence: 12 minutes 


7th Space Weather & NASA Robotic Mission Ops Workshop 


3 


^ Science & 
Tjggo'ogy 


MAG4 Background 




• Flares and CMEs are known to be drivers of the most severe space 
weather 

• Flares and CMEs typically originate in active regions (aka sunspots) 

• Flares and CMEs are examples of exceptionally large explosive 
releases of magnetic energy stored in the corona 

• While the amount of free energy cannot be measured directly, free- 
energy proxies can be measured 

• Event rates have been shown to be correlated with the magnitude of 
the free-energy proxies 
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• 1973 The MSFC (Marshall Space Flight Center) vector magnetograph was built to support 
Skylab 

• 2000-present MSFC used vector magnetograms to study CME correlation with tree- 
energy proxy 

• 2007-12 A DOD/Multidisciplinary University Research Initiative/Neutral Atmosphere 
Density Interdisciplinary Research helped support funding of the basic research 

• 2008 Partnered with JSC/SRAG (Space Radiation Analysis Group) and won an R20 
NASA/Technical Excellence Initiative grant: Began building a database that grew to 
-40,000 magnetograms of -1 ,300 active region, covering years 1996-2004 with event 
catalog from SOHO/MDI (Solar and Heliospheric Observatory/Michelson Doppler Imager) 
observations 

• 2010-present NASA’s HEOMD (Human Exploration and Operations Mission Directorate) 
support 

• 2010 SDO is launched began transitioning from MDI to HMI line-of-sight magnetograms. 

• 2011 MAG4 installed at SRAG a NRT (Near-Real-Time) forecasting tool , and SRAG 
began pre-operations testing 

• 2012 Provided NOAA web access to MAG4 NRT forecasts 

• 2013 Improve MAG4 so that it can use a combination of tree-energy proxy and previous 

flare activity 

• 2015 Transition to HMI line-of-sight to vector magnetograms 
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Contours Vertical Magnetic Field 

Arrows Transverse Magnetic Field Currents ~10 Amps 
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Process 2: Calculating the Free-Energy Proxy 



When the transverse 
gradient of the vertical (or 
line-of-sight) magnetic field is 
large, there is more free- 
energy stored in the 
magnetic field 

For each Active Region: 

The integral of the gradient 
along the neutral line is the 
free-energy proxy 



A magnetogram of an active region 


Neutral Line, color coded for gradient 
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Process 1 : Identifying Active Regions 




• Magnetograms are spatial 
maps of the magnetic field 
strengths 

• They come in two basic types 

- line-of-sight (right) 

- vector magnetograms 

• Free-energy proxies can be 
measured for Active Regions 
(areas with sunspots) from 
either type of magnetogram 

• Line-of-sight magnetograms 
suffer reduced accuracy 
further from disk center 



A full-disk line-of-sight magnetogram of 


Magnetograms & identify ARs 
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Process 3: Converting Free-Energy 
Proxy to Predicted Event Rates 





These empirical forecast curves are used to convert our free-energy proxy 
into predicted event rates. Curves are derived from a sample of 40,000 
magnetograms, from 1300 active regions observed between 1996-2004. 
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Process 4: Forecast 





Updated 2012 Mar 8 21:56:03 UTC 


NOAA/SWPC Boulder, CO USA I 


Multiplicative uncertainty example 

Rate 1 sigma Probability 

Events/day 66% Confidence 

0.02 0.01-0.05 0.7-5% 

0.7 0.3-1. 9 20-80% 


For a Multiplicative Uncertainty of 2.7x 


G0ES13 Proton Flux (5 minute data) 


2012 Mar 6 0000 UTC 


GOES Xray Flux (5 minute data) 


Begin: 2012 M or 6 OOOO UTC 
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Multiplicative Uncertainties 
Disk All-Clear Forecast Probabilities 
Uncertainties 


2.7x 2.1 x 2.2x 3. Ox 2.4x 
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Comparison of Safe and Not Safe Days 




June 26, 2013 March 7, 2012 

Cl, Cl. 5 flares X5.4, XI .3, Cl .6 

CME 2684, 1825 km/sec, 

Solar Energetic Proton Event reaches 
6530 particle flux unit >10MeV 
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1. Recent Flare History 




Free-Energy Proxy W(kG) 


Active regions that have recently produced an X- or M-Class flare are 
more likely to produce flares in the near future 
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2. Skill Metrics 





PC 

POD 

Percent Correct (0 to 1 00 %) 
Probability of Detection (0 to 1 ) 
False Alarm Rate ( 1 to 0 ) 

Predict Yes YY 

YN 

FAR 

Predict No NY 

NN 

HSS 

Heidke Skill Score (-1 to 1 ) 



TSS 

True Skill Score (-1 to 1 ) 


Mclntosh/NOAA 

259 

638 

631 

18476 

93.7 

0.29 

0.71 

0.26 

0.26 

Free-Energy Proxy 

273 

284 

618 

18830 

95.5 

0.31 

0.50 

0.35 

0.47 

Free-energy proxy and 
previous flare activity 

340 

317 

551 

18797 

95.7 

0.38 

0.48 

0.42 

0.49 

Best 

890 

0 

0 

19114 

100 

1 

0 

1 
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2. Skill Metrics Significance of Upgrade 



Mclntosh/NOAA 

259 

638 

631 

18476 

93.7 

0.29 

0.71 

0.26 

0.26 

Free-Energy Proxy 

Present MAG4 

273 

284 

618 

18830 

95.5 

0.31 

0.50 

0.35 

0.47 

Free-energy proxy and 
previous flare activity 

Upgraded MAG4 

340 

317 

551 

18797 

95.7 

0.38 

0.48 

0.42 

0.49 

Best 

890 

0 

0 

1911 

100 

1 

0 

1 
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Improvement in Metric 





Mclntosh/NOAA 

Present MAG4 

1 .8±0.5 

(4a) 

0.03±0.05 

(0.3a) 

0.21 ±0.07 

(3a) 

0.10±0.04 

(2a) 

0.21 ±0.07 

(3a) 

Present MAG4 
Upgraded MAG4 

0.2±0.2 

(0.7ct) 

0.08±0.03 

(2a) 

0.02±0.05 

(0.5ct) 

0.06±0.03 

(2a) 

0.03±0.05 

(0.5a) 
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How Well Does MAG4 Forecast: 



1 . Situational Awareness 


• During periods when flare-productive active regions cross the disk, the 
predicted rate and actual rate both increase, providing situational awareness 

• The results are best when flares and predicted rates are limited to inner 45 
degree circle (Right) 

M or X-Class Flares 
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MAG4 Improvements: Vector Magnetograms 




Both vectors shown in 
red have positive B z 
(magnetic field out of 
the sun), but have 
opposite sign B LOS and 
thus a false 

(unphysical) neutral line 
in the line-of-sight 
(LOS) field. 


Earth^ 


Problem fixed by 
converting from 
B los and 

^Transverse ^0 

and B Hor j ZOnta | 


Actual Examples 


False Neutral 
Lines occur on 
limbward sides of 
sunspots. 


'4 •*?. 
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Process 1 : Identifying Active Regions 



• Magnetograms are spatial 
maps of the magnetic field 
strengths 

• They come in two basic types 

- line-of-sight (right) 

- vector magnetograms 

• Free-energy proxies can be 
measured for Active Regions 
(areas with sunspots) from 
either type of magnetogram 

• Line-of-sight magnetograms 
suffer reduced accuracy 
further from disk center 



NOAA 


Active 


Regions 


(ARs) 


Best LOS 
Accuracy 


A full-disk line-of-sight magnetogram of 


Magnetograms & identify ARs | 
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Improvements with Vector MAG4 




• Correct for systemic errors in measurements due to radial dependence 
of transverse field noise and foreshortening. 

• Access skill scores relative to present LOS 

• Investigate if a vector measure is better than LOS measure 

• Investigate if change of measure is important 

• Investigate if combination produces better measure 

• Correct SPE forecasts based on Longitude of source region 

• Partner with heliosphere modeling to better forecast where the particles 
would go. 

• Twin CME 
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BACKUP 
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• Determine if growth/decay phase 
of an active region has additional 
prediction ability 


10696 9690 



• Determine if looking at twin-CME 
or single-CME can produce 
improved SEP forecasts 
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How Well Does MAG4 Forecast: 



2. Skill Metrics Equations 





Predict Yes 

YY 

YN 

Predict No 

NY 

NN 


Metric Equations 


Percent Correct 
Probability of Detection 
False Alarm Rate 
Heidke Skill Score 

True Skill Score 


PC=(YY+NN)/(YY+YN+NY+YY) 

POD=YY/(YY+NY) 

FAR=YN/(YY+YN) 

HSS=2*(YY*NN-YN*NY)/[(YY+NY)* 

(NY+NN)+(YY+YN)*(YN+NN)] 

TSS=(YY*NN-NY*YN)/((YY+NY)*(YN+NN)) 
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Today’s Forecast 


Questions 
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Research to Operations and Operations for FY14 






Continue to supply support, and upgrades to NASA/SRAG 

Finish and evaluate using vector magnetograms 

Fully implement in consultation with SRAG using combined tree-energy 
proxy and previous flare activity 

Improve All Clear Forecast for SEP 1000.0 

Partner with Air Force, and through them NOAA 100 0 

o 

^ 10,0 
CO 

_l 

$ 

_l 

1.0 
0.1 

10 20 1 0 21 10 22 1 0 23 1 0 24 
L <t> (Mx) 
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Free-Energy Proxy W(kG) 
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How Free Energy Proxy Evolves and Clustering of Flares 




Evolution of Free-Energy Proxy Forecasted X&M Flare Rate 




The free-energy proxy evolves on time periods of days => 

the forecast is on those time scales 
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2. Vector Magnetograms (In Progress) 



• MAG4 presently uses SDO/HMI 
line-of-sight magnetograms 

• Near-real-time ambiguity- 
resolved SDO/HMI vector- 
magnetograms have recently 
become available 

• We are transitioning to using 
these new data from SDO 

• Implementation just started 


7th Space Weather & NASA Robotic Mission Ops Workshop 



26 



^ Science Sc 
gdgdogy 


How well it works (All-Clear) 




Flares occur when high free-energy proxy active regions crossing disk. 


All Clear Probability 
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